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THE EFFECTS OF DIAGNOSTIC TESTING AND REMEDIATION ON 
SCIENCE ACHIEVEtlENT AND RETENTION* 

A nuinber of studied conducted during the last few years have shown 
that diagnostic-progress tests followed by remedial Instruction can be used 
to increase the achievement of pupils (Block and Biurns, 1976). A diagnostic 
or formative test is a brief progress test keyed to specific performance 
objectives* Diagnostic testing provides vital feedback to teachers as well 
as pupils* '^rom the results of diagnostic testing, teachers are able to 
monitor pupil progress » identify instructional weaknesses, and modify instruc- 
tion accordingly. Pupils are able to Identify gaps in their learning without 
the penalty of final judgment (in the form of grades) and to take necessary 
corrective measures. 

Following diagnostic testing and tabulation of results, some effective 
remediation strategy is needed for pupils who have not obtained ml:iimum 
achievement levels* The methods of providing remediation following diagnostic 
testing can be grouped into two major categories; teachers-directed remedial 
and pttpil-*dlrected remedial work* Teacher-directed remediation is defined 
as any remedial Instruction structered, organized, and prescribed by the 
teacher. Pupil*-directed remedial work is defined as any course of corrective 
action conceived and undertaken by pupils based on diagnostic test results* 

Several studies have shown that as the amount of assistance with 
diagnosis and remediation Increases, achievement scores show a corresponding 
increase* Collins (1971) studied mathematics learning with six groups of 
elementary pupils* The Increments of assistance in this study ranged in 

*Thl8 study was stipported, in part, by a grant from the Office of Research* 
University of Georgia, Athens, Georgia* 



variation from no aaslstance for the control group to performance objectives, 
diagnostic problems, knowledge of results, and provision of alternate remedial 
resourcea for the grotip receiving maximum assistance. Collins found that 
vhile only AOZ of the control group scored at the A or B level on the summa- 
tlve achievement test, 80Z of the group receiving maximum assistance reached 
these same levels of achievement. 

In a study consisting of five groups of undergraduate college students 
receiving physical science instruction, Goodson and Okey (1976) found signifl- 
cant treatment effects among groups receiving different increments of diagnostic 
assistance and variation in types of remediation. The types of remediation 
included a) reteachlng Incorrect responses on the diagnostic test, b) encour- 
aging students to ask questions concerning Items missed on the diagnostic 
test, and c) instructing students to find, on their own, answers cO Incorrect 
responses on the diagnostic test. The groups receiving some form of teacher- 
directed remediation scored significantly higher on short-term achievement 
measures than groups receiving no assistance or groups planning their own 
remediation. 

In the extensive summary of research on diagnostic-remedial procedures 
prepared by Block and Bums (1976) , It was concluded that pupils receiving 
maximum learning guidance retained knowledge longer than groups receiving 
less assistance* In the retention studies that they review (about 30 In 
nunber) involving Instructional intervals ranging from a few weeks to a fe\^ 
months, pupils receiving learning assistance scored siguificantly higher 63% 
of the time and generally higher almost all of the tine. The cause and effect 
relationships between specific components of assistance (i.e*. performance 
objectives, diagnostic testing^ prescriptive remediation) and retention have 
not, however, been firmly established. This is illustrated in the Goodson 
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and Okey (1976) study cited earlier in this paper* I'Jhlle the groups receiving 
a form of teacher-directed remedial work scored higher on initial achievement 
measures, retention results favored the groups planning their own remediation. 

The intent in this study was to provide learners with differing incre- 
ments and types of remedial assistance and examine the effects on short-terra 
cognitive achievement, retention, and attitudes toward instruction. Affective 
outcomes were of concern in this study because the amount of interaction 
between students and teachers varies depending on the amount of participation 
by teachers in directing remedial work that follows diagnostic testing. Studies 
involving the affective consequences of diagnostic-prescriptive teaching have 
not been aa extensive as the cognitive studies, \ftile these studies have 
often favored groups receiving diagnosis and prescription, the findings are 
Inconclusive (Block and Bums, 1976). 

Research Questions 

1» Will science achievement and retention be influenced by the types 
and amount of diagnostic-remedial assistance that students receive? 

2* Does diagnostic-prescriptive assistance have a consistent influence 
on student achievement across units in a science course? 

3. Will student attitudes and opinions about their science instruction 
be influenced by the type and amount of diagnostic-prescriptive 
assistance that they receive? 

The rationale for selection of the independent variables in this study 
(i.e., the amount and type of assistance in diagnostic-prescriptive instruction) 
arises from an awareness of the day-to-day problems encountered by teachers. 
Fixed time schedules, heavy course loads, and large classes combine to dis- 
courage many teachers from any attempts to provide instruction that identifies 
and treats individual learning problems. Considering the time and materials 
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required to include diagnostic evaluation and remedial work as part of Instruct 
tl<m» it is not unreasonable for teachers to await assurance that their efforts 
are l ike ly to bring about favorable cognitive and affective outcomes. 

Methodology* 

Sapg)le_ 

All the eighth grade studencs (n«159) from a middle school served as 
the subjects for the study* The students came from classes taught by 3 
teachers who taught science in adjoining rooms during the same period at two 
tines (morning and afternoon) each day. The students were primarily from 
middle to low 8ocio-*economlc status homes* The racial composition of the 
group was approximately 35 percent black and 65 percent white* 

Design 

A 3 X 3 (aptitude x treatment) design was used In the study* This was 
done by using scores from a teacber-*made aptitude test to establish groups of 
high (top third) » middle, and low (bottom third) aptitude students* Students 
from each aptitude group were then assigned at random to three experimental 
groups* Each of the three teachers was randomly assigned to one of the groups 
of students and experimental treatments were randomly assigned to each of the 
teachers. 

The process of assigning students, teachers, and treatments was done 
for the momlng block of classes and repeated for the afternoon block* The 
result was to achieve a random assignment of students to treatments and a 

*The assistance of Dr* Frusanna Booth, Dr* Helen Westbrook, Ellen Hanna, Mabel 
Mitchell, and Ron Patenaude (all from the Clarke County Public Schools) lu 
arranging for and conducting this study is greatly appreciated* 
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ratidom asslgmnent of treatments to teachers* Morning and afternoon students 
in the same treatment group were considered one block of students In the 
data analysis* 

Teachers rotated asslgnnents with students and treatments for the three 
units so that each teacher taught each group of students and used each treat- 
ment condition. This was done to remove the systematic bias that might result 
from a teacher consistently using one method of Instruction or working with 
one groxtp of students. The practice of rotating students to different teachers 
for different units was already folloi^ed In the school so students were 
accustomed to this procedure before the experiment began. 

Treatments 

The teachers administered the treatments using materials especially 
developed for this study* The materials prepared for the 5-week block of 
instruction (covering units on earth motion » latitude and longitude » and map 
skills) Inc luded : 

o 28 performance objectives for the three units 

« 9 reading assignments (from 2 textbooks) keyed to the objectives 

^ 12 worksheets for students to complete individually or in pairs 

« 9 group demonstrations for the teacher to give (requiring about 15 
minutes each) during the three units (e.g., using a globe and 
flashlight in a darkened room to show how the ninnber of daylight 
hours varies with the season)* 

^ checklists to guide students through the readings » worksheets, and 
demonstrations * 

o 56 diagnostic test items keyed to the objectives (two per objective)* 
These were provided as two versions each of 13 diagnostic progress 
testa ;r each consisting of 2 or 3 items on 1 or 2 objectives. 

The materials just described were used by the teachers under three 

treatment conditions* 7 



Treatment 1 (Control Group) 

Students received the same instructional materials as the other two 
groups except that no objectives were given to then, no diagnostic 
progress tests were administered , and no remedial Instruction under- 
taken* 

Treatment 2 (Student-Directed Remedial Work) 

Students were provided with objectives, reading assignments, work- 
sheets; group demonstrations ) and checklists* Diagnostic progress tests 
were given on an individual basis at about 2-day Intervals when the 
corresponding learning materials had been completed* Diagnostic tests 
were scored Immediately or over night* The tescs v;ere returned to the 
students and they were told to use the results to guide their own 
efforts to correct errors. No follow-up progress tests were given and 
teachers did not make additional attempts to identify or remedy learning 
problems* 

Treatment 3 (Teacher-Directed Remedial Work) 

Students followed instruction the same as In Treatment 2 except 
that they were given specific assignments of remedial work to complete 
to correct any problems shown by the tests. A second progress test v/as 
given folloT-Tlng this additional study* If problems persisted, the 
teacher attempted to use individual tutoring to solve them. Students 
that were still having difficulty at this point were encouraged to 
move on to new material even though they had not achieved the objectives. 



Instriiments 

Tests referenced to the objectives provided to the teachers were given 
at the end of each of the three units (about every 8 instructional days) . An 
unannounced retention test covering all three units was given 12 weeks after 
completion of r.he final unit. The collective judgment of the experimenters 
was used to establish that the Items on all measixres provided valid tests of 
the stated objectives. Students also completed a questionnaire after the 
study to determine their attitudes toxrard the instruction. Table 1 provides 
a summary of the instruments used in the study. 
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All tests were scored in random order by the investigators so that it 
vas not known to which treatment group a paper belonged. Model answers were 
prepared and papers were scored on the degree to which answers provided by 
students fit the model answers. 



TABLE 1 

INFORMATION ON THE INSTRUMENTS USED IN THE STUDY 



Instrument 


! 

Purpose 


Number and 
Type of Items 


Time to 
Complete 
(minutes) 


Reliability 
Estimate* 


Student 
Questionnaire 


Measure atti- 
tudes toward 
Instruction* 


10 Items, 
Llkert scale 


10 


.76 


Earth Motion 
Test 


Unit test on 
objectives 


28 Items, 
open response 


30 


.92 


Latitude and 

Longitude 

Test 


Unit test on 
objectives 


26 Items^ 
open response 


30 


.94 


Map skills 
Test 


Unit test on 
objectives 


31 Items, 
open response 


40 




Retention 
Test 


Measure long- 
term retention 


36 Items, 
multiple choice 


25 


.93 



^Reliabilities were determined by selecting 30 papers at random 
from all papers available and calculating the split-half 
reliability* The resulting reliabilities were then stepped 
up to the original teat length to produce the value reported here. 

**This unit test was corrected, recorded, and then lost before 
reliability estimates could be made* 
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RESULTS 



^ The group achievement means for the 3 science units , the retention test 

mean scores » and the mean attitude scores are presented In Table 2. Two-way 

v analysis of variance procedures with treatment and aptitude as main effects 
variables were employed to determine the probability of real differences 
anong these means. 

7 TABLE 2 

: MEANS AND STANDARD DEVIATIONS OF ACHIEVEMEtlT 

Aifl) ATTITUDE SCORES ACROSS TREATMENTS 





Tx 


T2 


T3 


S.D. 


Unit 1* 


29.4 


31.2 


36.5 


9.1 


Unit 2* 


27.0 


34.8 


34.7 


10.6 


Unit 3* 


36.8 


35.7 


39.2 


9.8 


Retention** 


21.8 


21.6 


22.3 


4.6 


Attitude*** 


36.5 


37.7 


34.8 


6.5 



^maximum possible score « 60 
**maxlmum possible score * 36 
***maxlmum possible score • 50 



On the basis of the calculated F ratios, the main effects of treatment 
and aptitude both appeared to have Influenced achievement In Unit 1 (See 
Table 3) . Further analyses were needed to detcrtnlne which treatment groups 
were achieving significantly better than others* Newman-Keuls post-hoc 
coiiq)arlson procedures were chosen for this purpose and Indicated that the T3 
(teacher^dlrected remediation) group achieved significantly better than any 
other group (p<.05). No other differences due to treatment were found. 

10 



TABLE 3 

ANALYSIS OF VARIANCE SWCIARY 
TABLE FOR ACHIEVE^tENT OH U>JIT 1 



Source of 
Variation 


df 


Mean 
Square 


F 


P 


treatment 


2 


370.0 


4.46 


.013 


aptitude 


2 


8590.6 


103.63 


.001 


T X A 


4 


151.9 


1.83 


.125 


error 


131 


82.9 







The calculated F values on the main effects again indicated that 
there was a significant difference due to treatment and aptitude In Unit 2 
(see Table 4). Foat-hoc analyses indicated that significant differences in 
achievement favored T3 (teacher-remediation) and T2 (self-rejnedlatlon) over 
Ti (control). No other differences due to treatment were fvwnd. 



TABLE 4 

ANALYSIS OF VARIANCE SUTHIARY TABLE FOR 
ACHIE\T2MEHT ON UNIT 2 





Source of 
Variation 


df 


Mean 
Square 


F 


P 


treatment 


2 


956.1 


8.47 


.001 


aptitude 


2 


8396.7 


74.35 


.001 


T X A 


4 


145.4 


1.29 


.227 


error 


131 


112.9 
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Two-way analysis of variance procedures were also used to assess 
difference In achievement which could be attributed to the effects of treat- 
neat In Unit 3 and on the retention test. The analyses revealed no significant 
differences (p<.05) which could be attributed to treatment (see Tables 5 and 
6). 

TABLE 5 

ANALYSIS OF VARIANCE SUMMARY TABLE FOR 
ACHIEVEMENT ON UNIT 3 



Source of 
Variation 


df 


Mean 
Square 


F 




treatment 


2 


45.3 


.46 


.999 


aptitude 


2 


7343.3 


77.12 


.001 


T X A 


4 


47.2 


.50 


.999 


error 


131 


95.3 










TABLE 


6 






ANALYSIS 


OF VARIANCE SUMMARY TABLE 
RETENTION ON ALL UNITS 


FOR 




Source of 
Variation 


df 


Mean 
Square 


F 


P 


treatment 


2 


.02 


.001 


.999 


aptitude 


2 


1455.67 


67.58 


.001 


T X A 


4 


32.98 


1.53 


.196 


error 


131 


21.54 
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On all the data analyses, student aptitude was entered as a three- level 
factor in the design. In all cases the aptitude variable appeared as a 
significant (p<.001) loaln effect (see Tables 3| 4, 5 and 6). Po8t*-hoc analyses 
indicated that without exception the high aptitude group achieved significantly 
above the middle group which achieved above the low. 

The analysis for treatment effects on the attitude mean scores Indicated 
no significant differences among treatments (see Table 7). However* all groups 
expressed a positive attitude toward the Instruction. 



TABLE 7 

ANALYSIS OF VARIANCE SUMMARY TABLE FOR 
ATTITUDE TOWARD METHOD OF INSTRUCTION 



Source of 
Variation 


d£ 


Mean 
Square 


F 


P 


treatment 


2 


97.1 


2^3 


.105 


aptitude 


2 


109.8 


2.6 


.08 


T X A 


4 


21.2 


.5 


.999 


error 


133 


A2.8 







PlacuBslon and Conclusions 

The results of this study Indicate that science achievement Is positively 
influenced by diagnostic-remedial assistance • ^^lle It cannot be shown that 
either the amount or type of diagnostic remedial assistance had consistent 
effects acrosa all science units ^ it is interesting to note that the groups 
receiving diagnostic assistance (i.e.> either teacher^directed or student- 
directed reaiediation) scored higher on 10 of 12 cognitive meastires and 
significantly higher on two unit measures. 
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It is not clearly understood why significant effects of diagnostic- 
renedlal Mslatance were not consistent across all three science units* Such 
Influences as a teacher effect, nature of content, or Instructional activities 
aay have acted Independently or In combination to account for the results. 

There were no difference detected among group means on the retention 
HMSure despite the real differences found on 2 of the 3 unit tests « There 
findings were not consistent with the retention studies cited by Block and 
Bums (1976) « 

One of the eicpected effects of diagnostic-remedial assistance Is to 
minimize the differences in pupil achievement occurlng as a result of 
differences in pupil aptitude* In this study the effects of aptitude on 
achievement were not discounted by diagnostic-remedial assistance. Without 
exception, the aptitude of pupils had a significant effect on achievement* 

While significant differences In pupil attitudes toward science Instruc- 
tion were not found between s^o^ps, there Is no Indication that achievement 
gains attributed to dlagnostlc^remedlal assistance occur at the expense of a 
decline In pupil attitudes toward Instruction* It is conceivable that middle 
school pupils acclimated to group-paced instruction would be initially anxious 
or perhaps threatened by remediation and mastery expectations* If this was 
the case, a divergence in cognitive and affective progress may occur* No 
such divergence was detected as all groups expressed a positive attitude 
toward instruction* 

The results of this study are in accord with much of the previous work 
on diagno8tlc«*pre8criptlve procedures — diagnosis and prescription influences 
cognitive achievement but not consistently* However, the results of this 
study failed to support the findings of Goodscn and Okey (1976)* They found 

14 



u5 cotifllstent Influences on achievement of both teacher- and student- guided 
^ remedial work with college age science students. Moreover, the Influences 
£ held up on a retention test. Neither consistent influences of diagnostic- 

prescription on short term tests nor on retention measures were found in this 
3 study with m.lddle school students. 
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